logo logo International Journal of Educational Methodology

IJEM is a leading, peer-reviewed, open access, research journal that provides an online forum for studies in education, by and for scholars and practitioners, worldwide.

Subscribe to

Receive Email Alerts

for special events, calls for papers, and professional development opportunities.

Subscribe

Publisher (HQ)

RHAPSODE LTD
Eurasian Society of Educational Research
College House, 2nd Floor 17 King Edwards Road, Ruislip, London, UK. HA4 7AE
RHAPSODE LTD
Headquarters
College House, 2nd Floor 17 King Edwards Road, Ruislip, London, UK. HA4 7AE

' Rasch measurement model' Search Results



...

Assessment for Learning (AfL) may be conceptualized as minute-to-minute, day-by-day interactions between learners and teachers with the improvement of learning as the principal focus. This paper traces the development of an AfL measurement instrument (scale) that can be used for research purposes prior to, during and following professional development in the area. Rasch measurement procedures were applied to data drawn from a convenience sample of 594 teachers from 44 elementary schools in Ireland to create a scale consisting of 20 items distributed across four key AfL assessment strategies: learning intentions and success criteria, questioning and classroom discussion, feedback, and peer-and self-assessment.  This scale, the Assessment for Learning Measurement instrument (AfLMi), has good psychometric properties and is interpretable in a way that makes it potentially useful during system wide improvement initiatives focused on AfL.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.3.2.103
Pages: 103-115
cloud_download 1424
visibility 1710
5
Article Metrics
Views
1424
Download
1710
Citations
Crossref
5

Scopus

...

Positive attitude towards statistics is a desirable aspect in developing statistical thinking and understanding statistical concept. The attitude towards statistics instrument in previous study on rural school students lacked evidence in the validity analysis. Therefore, there is a need to provide a valid instrument that can assess rural secondary school students’ attitude toward statistics. For this purpose, this study was carried out to investigate the validity and reliability analysis of the Survey Attitude towards Statistics (SATS-36) instrument from a sample of rural secondary school students. The SATS-36 is a 7-point Likert type scale questionnaire, used to measure students’ attitude towards statistics. The SATS-36 instrument was distributed to 217 Tenth grade science stream students from a rural district in Sabah, Malaysia, which comprised of 66 (30.4%) boys and 151 (69.6%) girls. A second order Confirmatory Factor Analysis (CFA) was carried out to analyze the validity of the SATS-36 instrument as well as to confirm the 6-factor model of SATS-36. The reliability of SATS-36 instrument was assessed through the Cronbach’s Alpha value. Overall, the analysis showed that the SATS-36 instrument shows favorable indices for both its validity and reliability. Thus, it can be concluded that the SATS-36 was a valid and reliable instrument for measuring students’ attitude towards statistics among rural science stream secondary school students.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.5.4.651
Pages: 651-661
cloud_download 1185
visibility 1706
16
Article Metrics
Views
1185
Download
1706
Citations
Crossref
16

Scopus
14

...

Progress monitoring of academic achievement is an essential element to prevent learning disorders. A prominent approach is curriculum-based measurement (CBM). Various studies have documented positive effects of CBM on students’ achievement. Nevertheless, the use of CBM is associated with additional work for teachers. The use of tablets may be of help here. Yet, although many advantages of computer- or tablet-based assessments are being discussed in the literature (e. g. innovative item formats, adaptive testing, automated scoring and feedback), there are still concerns regarding the comparability of different assessment modes (paper-pencil vs. tablet). In the study presented, we analyze the CBM data of 98 fourth graders. They processed the exact same computation items once with paper and pen and once in a tablet application. The analyses point to comparable results in the test modes, although some significant deviations can be found at item level. In addition, the children report perceived benefits when working with the tablet.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.6.4.669
Pages: 669-680
cloud_download 1036
visibility 1198
13
Article Metrics
Views
1036
Download
1198
Citations
Crossref
13

Scopus

...

This study aims to produce empirical evidence of the validity and reliability of instrument items for the competency framework of agricultural teaching staff in Malaysian agricultural vocational colleges. The validity and reliability of the framework were analyzed using Rasch Model Measurement assisted by Winsteps 3.72 software. This research instrument contained 116 items, which was distributed to 30 instructors at the Teluk Intan Agricultural Vocational College, Malaysia. The selection of respondents was made by strata random where the researcher makes the strata of the population according to the percentage and then selects randomly based on the desired percentage. Validity analysis of the instrument was done through four functional testings. For reliability and separation of respondents, it was found that the individual reliability value was very good and acceptable. The results of the item polarity analysis detected no negative value (-) in the Point Measure Correlation value. Item matching analysis found that 11 items had to be dropped as they failed to meet the required conditions. From the analysis on local dependence that determines dependent items based on the standardized residual correlation value, it was discovered that the correlation value for the items used was detected; 13 items need attention. The results of the data analysis checking the functionality of the items suggested that some items should be dropped. The omission of these items has provided evidence that the instrument of competence of agricultural instructors is crucial to have a high level of validity and reliability for use in actual studies.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.7.3.411
Pages: 411-420
cloud_download 323
visibility 571
2
Article Metrics
Views
323
Download
571
Citations
Crossref
2

Scopus
2

...

This research analyzed the involvement of teachers, parents, and school committees in improving scientific attitudes in science learning using Rasch model analysis. A survey method was used in this quantitative study. Participants in the study were selected using a purposive sample of 174 teachers, parents, and school committees in Sleman and Kebumen Regencies, Indonesia. A questionnaire was used in data collection to determine the involvement of teachers, parents, and school committees in improving scientific attitudes toward science learning. The questionnaires were completed using a Likert scale of 1-4, and the data were then analyzed using the Rasch model. The result showed that all participants were the average logit items (+1.03 logit). The reliability was 0.89, indicating a positive response to improving students' scientific attitudes. The results of the Rasch model analysis suggested that the involvement of parents, teachers, and school committees in improving scientific attitudes differed according to their roles. Each instrument element was analyzed in more detail in the Rasch model. Participants' roles were reflected in the specific involvements of teachers in learning, parents at home with children, and school committees participating in school policy-making.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.8.4.783
Pages: 783-794
cloud_download 378
visibility 7202
0
Article Metrics
Views
378
Download
7202
Citations
Crossref
0

Scopus
0

...

The purpose of this study was to establish the factor structure and dimensionality of the Metacognitive Orientation Learning Environment Scale – Science (MOLES-S) in the Thai context. The metacognitive orientation of a science classroom learning environment is defined as the extent to which psychosocial conditions that are known to enhance students’ metacognition are evident in a specific science classroom. This study builds on earlier work in the research areas of science education, metacognition, and learning environments. A sample of 5418 Thai science students in grades 10 to 12, from 40 schools across Thailand, completed the MOLES-S that had been translated into Thai. Exploratory factor analysis was undertaken and Rasch analysis was used to calibrate the scale and explore its dimensionality. The results suggest that the MOLES-S(T), where (T) represents Thailand, has the same factor structure as the original MOLES-S, is reliable, and can be used with confidence in research into metacognition in Thai high school science classrooms.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.8.4.805
Pages: 805-818
cloud_download 196
visibility 404
2
Article Metrics
Views
196
Download
404
Citations
Crossref
2

Scopus
1

Graded Response Models on the Curiosity Measurement of Elementary School Students

curiosity measurement elementary school graded response models

Herwin Herwin , Riana Nurhayati , Aprilia Tina Lidyasari , Augusto da Costa


...

Curiosity is one of the most important characters for elementary school students. However, the facts in the field show that the measurement model used by the teacher to identify the student's curiosity is not yet available in a standardized manner. This study aims to develop a model for measuring the curiosity of elementary school students using the graded response model (GRM) approach. This research uses quantitative method with descriptive type. The research sample used was 236 elementary school students who were randomly selected. Data were collected using a questionnaire of 16 statement items using a Likert scale approach. The data were analyzed using the response item theory approach with the GRM. The results showed that the model for measuring student curiosity in elementary schools had good location parameters, a good discriminant index, a fairly good information function with a small estimation error. The curiosity measurement model in this study can be used as an alternative for teachers to identify students' curiosity in elementary schools.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.9.1.53
Pages: 53-62
cloud_download 314
visibility 572
0
Article Metrics
Views
314
Download
572
Citations
Crossref
0

Scopus
0

...

The purposes of this research are (a) to make an instrument to measure the achievement of project-based digitalpreneurship learning in students; (b) to describe the quality of the project-based digitalpreneurship learning achievement assessment instrument for vocational high school students; (c) to measure the competence and skills. This study employed to research and development as its methodology, using a combination procedure between Oriondo and Antonio and, Mardapi. The development procedure includes three stages: instrument design, instrument testing, and measurement. A total of 795 students who participated in the study at 5 vocational high schools in Yogyakarta's special region served as responders. Data analysis in this development uses the content validity of the formula Aiken V Index, confirmatory factor analysis establishes the construct's validity, and construct reliability. Measurement instrument development. Research findings that (a) the instrument is ready to be used in the measurement; (b) the quality of the project-based digitalpreneruship learning achievement assessment instrument for vocational high school students is well tested. This is evidenced by the validity test which has a high score >.8; The proof of construct validity in this study using CFA > .5; GOF chi-square value with a critical value of df = 289, X2 = 323, p-value with a critical value of .079, RMSEA with a critical value of RMSEA .019 (≤ .08), SMRM with a critical value of SRMR 0.030 (≤ .05), CFI with a critical value of CFI .990 (> .97), and an NFI with a critical value of NFI .989 ( > .90); (c) the measurement results are identified in the process that needs to be improved again regarding the digitalpreneurship skills of vocational high school students.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.9.1.283
Pages: 283-295
cloud_download 227
visibility 357
0
Article Metrics
Views
227
Download
357
Citations
Crossref
0

Scopus
0

...

The role of artificial intelligence (AI) in education remains incompletely understood, demanding further evaluation and the creation of robust assessment tools. Despite previous attempts to measure AI's impact in education, existing studies have limitations. This research aimed to develop and validate an assessment instrument for gauging AI effects in higher education. Employing various analytical methods, including Exploratory Factor Analysis, Confirmatory Factor Analysis, and Rasch Analysis, the initial 70-item instrument covered seven constructs. Administered to 635 students at Nueva Ecija University of Science and Technology – Gabaldon campus, content validity was assessed using the Lawshe method. After eliminating 19 items through EFA and CFA, Rasch analysis confirmed the construct validity and led to the removal of three more items. The final 48-item instrument, categorized into learning experiences, academic performance, career guidance, motivation, self-reliance, social interactions, and AI dependency, emerged as a valid and reliable tool for assessing AI's impact on higher education, especially among college students.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.10.2.997
Pages: 197-211
cloud_download 74
visibility 220
0
Article Metrics
Views
74
Download
220
Citations
Crossref
0

Scopus
0

...